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Abstract 

This group randomized controlled trial (RCT) evaluated the efficacy of the Incredible Years Teacher Classroom Management 
Program (IY TCM) on student social behavioral and academic outcomes among a large diverse sample of students within an 
urban context. Participants included 105 teachers and 1817 students in kindergarten to third grade. Three-level hierarchical linear 
models (HLM) were conducted to examine the overall treatment effects on teacher-reported student behavior and academic 
outcomes. In addition, multi-level moderation analyses were conducted to examine whether the treatment effects on student 
outcomes differed by demographic variables and pretest measures of social emotional and disruptive behavior and academics. 
Findings indicate that Y TCM reduced student emotional dysregulation (d =— 0.14) and increased prosocial behavior (d= 0.13) 
and social competence (d= 0.13). In addition, students initially lower on measures of social and academic competence demon- 
strated significant improvements on the same measure at outcome in comparison to similar peers in control classrooms. Practical 


significance of the findings and implications for schools and policy makers are discussed. 
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Ineffective classroom behavior management practices are associ- 
ated with disruptive classroom behaviors that interfere with in- 
struction, child development, and academic achievement. In poor- 
ly managed classrooms, students have little structure or support 
for consistent behavioral expectations and, as a result, students 
may be off task more and engage in higher rates of disruptive 
behaviors (Jones and Jones 2004). Negative teacher-student inter- 
actions are also more likely to occur in poorly managed class- 
rooms (Conroy et al. 2009; Reinke and Herman 2002), and these 
classroom environments can contribute to students’ risk for devel- 
oping behavior problems (Webster-Stratton and Reid 2004). 
Ineffective classroom management has also been linked to long- 
term negative academic, behavioral, and social outcomes for stu- 
dents (Kellam et al. 1998; National Research Council 2002). 
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At the same time, considerable research has demonstrated 
that teachers can promote a positive classroom environment 
through the use of effective universal classroom management 
strategies (Curby et al. 2013; Ialongo et al. 2001; Simonsen et 
al. 2008). Teachers trained in effective classroom management 
strategies can help students who are aggressive, disruptive, and 
uncooperative to develop the appropriate social behavior that is 
a prerequisite for their success in school (Walker et al. 1995). 
Even though research clearly supports the use of specific class- 
room management practices, such as praise and proactive 
teaching, direct observations of teachers indicate they do not 
regularly use these practices (e.g. Reinke et al. 2013a). Further, 
many teachers find managing student disruptive behavior chal- 
lenging and request additional training and support in the area 
of classroom management (Reinke et al. 2011). Thus, there is a 
need for prevention interventions that focus on training teachers 
to use classroom strategies that are developmentally appropriate 
and supportive of students’ emotional and behavioral growth. 


The Incredible Years Teacher Classroom 
Management Program 


The Incredible Years Teacher Classroom Management 
Program (IY TCM) is a universal classroom management 
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program for teachers of students in pre-school through third 
grade. TY TCM uses social learning theory (Bandura 1977) via 
video modeling to increase teacher learning of new skills. 
During each training session, teachers view video recordings 
of effective strategies, role-play the use of strategies, and re- 
ceive feedback from the [YY TCM leaders and other teachers 
participating in the group. TY TCM is principle driven and 
therefore flexible in adapting to the skill levels and specific 
classroom experiences of each teacher (Webster-Stratton et al. 
2011). The TY TCM incorporates teacher experiences and the 
cultural contexts of the participants’ classroom into the work- 
shop training content. Teachers learn key classroom manage- 
ment skills through discussion, observation of video-recorded 
examples of classroom situations, role-play rehearsal, and ver- 
bal and written assignments that are reviewed and returned 
(Webster-Stratton et al. 2004). In addition, the TY TCM em- 
beds coaching within the training model. After and between 
each training session, teachers are followed by a coach who 
conducts observations, provides performance feedback, and 
assists with problem solving, goal setting, and implementation 
of strategies (Reinke et al. 2012). 


Supporting Evidence for the lY TCM Program A number of 
randomized control trials (RCTs) of the IY series have includ- 
ed the TCM program. The first RCT was a prevention trial 
with 272 students from head start and their mothers (Webster- 
Stratton et al. 2001). Participants were randomly assigned to 
either the TY parent and teacher programs or a control condi- 
tion. Results indicated that in classrooms of teachers receiving 
IY TCM, students were observed to have higher on-task be- 
havior, increased pro-social behaviors, and decreased aggres- 
sion. A second RCT was conducted with 159 students diag- 
nosed with conduct problems (Webster-Stratton et al. 2004). 
The study compared child and parent training with and with- 
out TY TCM, resulting in five combinations of IY programs 
(three with TY TCM) and a no-treatment control condition. 
Teachers who received LY TCM were observed post- 
intervention to use more praise and be more nurturing, con- 
sistent, and confident than teachers who did not receive IY 
TCM. Additionally, students in classrooms with teachers who 
received [TY TCM were significantly less aggressive with 
peers and more cooperative with teachers. A third trial of the 
ITY TCM conducted by Webster-Stratton et al. (2008) showed 
similar effects in preschool settings for an TY TCM interven- 
tion combined with the TY child curriculum. 


IY TCM Only Evaluations A few studies have evaluated the 
impact of the TY TCM program as a stand-alone intervention. 
Hutchings et al. (2007) using a sub-sample of students in each 
classroom with low and high ratings of conduct problems 
found that primary school teachers in Wales who received 
the LY TCM as compared to teachers who had not significant- 
ly increased their use of direct commands (d = 0.94) and praise 
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(d=0.86). Further, the students in classrooms of trained 
teachers were significantly more compliant (d=0.63) and 
had more positive classroom behaviors (d= 0.99) than stu- 
dents in classrooms of untrained teachers. More recently, 
Hitchings, Martin-Forbes, Daley, and Williams (2013) evalu- 
ated the efficacy of the LY TCM to improve teacher behavior, 
student behavior classroom-wide, and with students at risk of 
developing conduct problems. Participants included six inter- 
vention and six control classrooms comprising 12 teachers 
and 107 students at risk of developing conduct problems (aged 
3 to 7 years). Results showed a significant reduction in ob- 
served classroom off-task behavior (d= 0.53), teacher nega- 
tives to target students (d= 0.36), target child negatives to- 
ward the teacher (d= 0.42), and target child off-task behavior 
(d= 0.48). Although the results were promising, the study was 
limited by the small sample. 


Rationale for the Current Study The IY TCM as a stand-alone 
intervention has great potential to positively impact large 
numbers of students given that each year teachers have up to 
30 students in their classrooms. The prior studies discussed 
have shown promising results for the [YY TCM program on 
teacher and student behavior, although none without limita- 
tions. Further, none of the TY TCM studies have investigated 
the potential impact of the TY TCM program on academic 
outcomes. By promoting student skills and reducing disrup- 
tive behaviors, [YY TCM implementation may allow for more 
instructional time and more student time on task which could 
lead to more learning and higher academic performance. 

The purpose of this study was to evaluate the efficacy of the 
IY TCM program using a large group RCT on student social 
emotional, disruptive behavior, and academic outcomes in 
schools. This is one of the first large-scale stand-alone evalu- 
ations of the YY TCM program with the full range of elemen- 
tary school teachers (kindergarten to third grade) that investi- 
gates both change in student social behavior and academic 
outcomes for students. Based on previous research (e.g., 
Webster-Stratton et al. 2001; Webster-Stratton et al. 2004), 
we hypothesized that students in the classrooms of teachers 
who received the TY TCM intervention would demonstrate 
reductions in concentration problems, disruptive behaviors, 
and emotional dysregulation in comparison to students in 
classrooms of the control group teachers. We also expected 
students in classrooms of teachers who received the TY TCM 
intervention to demonstrate increases in prosocial behavior, 
overall social competence, academic competence, and aca- 
demic achievement. 

Lastly, there is a growing body of research suggesting that 
the effects of universal prevention programs may not be con- 
sistent across the full population of students exposed to the 
program (Farrell et al. 2013; Schochet et al. 2014). In fact, 
there is emerging evidence that the variation in intervention 
responsiveness may be predicted by baseline behavioral or 
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social emotional risks (e.g. Bradshaw et al. 2015; Kellam et al. 
1998). Such variation is expected in a developmental epide- 
miological conceptual framework (Kellam et al. 1991). In this 
framework, the presence of a social, emotional, or behavioral 
problems (such as disruptive behaviors, concentration prob- 
lems, low social skills, academic problems, and emotional 
dysregulation) interferes with a child’s ability to adjust to the 
social demands of the classroom and makes it more likely 
these very problems will escalate over the course of the year 
without intervention. For instance, several studies examining 
variation in the impact of the Good Behavior Game, another 
universal prevention intervention targeting teacher use of ef- 
fective classroom management practices, demonstrated that 
intervention effects were strongest among youth who 
displayed a high level of antisocial behavior at baseline 
(Kellam et al. 1998; van Lier et al. 2005), highlighting the 
importance of investigating the potential for baseline risk as 
a factor influencing variation of outcomes in prevention inter- 
ventions. Therefore, consistent with a developmental epide- 
miological lens and prior research, we expected that students 
with more disruptive behavior or lower levels of social emo- 
tional competence and academic functioning would benefit 
more from the intervention than similar students in the control 
group (e.g., moderating effects of baseline risk on outcomes). 


Methods 
Participants and Setting 


Participants in this group RCT were 105 teachers and 1817 
students in kindergarten to third grade, from nine urban 
schools in a school district in the Midwestern part of the 
USA. All the schools were implementing school-wide 
Positive Behavior Supports and Interventions (PBIS; 
Sugai et al. 2002), with high fidelity (scores above 90% as 
gathered and reported by independent state evaluators). 
PBIS is a universal prevention intervention focused on 
teaching behavioral expectations and providing reinforce- 
ment to students for demonstrating those expectations. 
District-wide implementation of PBIS added strength to 
the design because it provided uniformity of behavior sup- 
port programs across intervention and control schools. 
Nearly all schools across the country are implementing a 
multitude of social-emotional or behavioral intervention 
programs that often operate from different perspectives 
and levels of efficacy. For instance, on average, each school 
in a recent trial was implementing five separate social emo- 
tional intervention programs in a given year (Bradshaw et 
al. 2010). Therefore, having PBIS added consistency and 
reduced noise across buildings. However, even when PBIS 
is implemented with high fidelity at the school level, 
teachers may still struggle with proactive classroom 
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management. For instance, in a study using data from class- 
rooms in this trial, only three out of 34 teachers provided 
more positive than negative attention to students, with all 
but one teacher below the recommended 4:1 ratio of positive 
to negative attention (Reinke et al. 2013a, 2013b). Thus, 
offering a classroom-level intervention was expected to 
have an additive effect to school-wide PBIS. 

As indicated in the participant flowchart (see Fig. 1), the 
study had high rates of enrollment for eligible teachers (96%) 
and students (84%). All teacher participants and parents of 
student participants provided written consent, and all students 
provided written assent to participate in the study. A blocked 
cluster random assignment design was utilized. Teachers were 
randomly assigned at the classroom level to receive YY TCM 
or to a wait list, business as usual control group with the 
constraint that the number of intervention teachers be no more 
than one more or less than the number of control teachers. 
Control teachers were offered the intervention 2 years follow- 
ing the year they participated. Teacher participants were re- 
cruited and randomized across three cohorts [year 1: 34 
teachers (17 intervention), 577 students; year 2: 34 teachers 
(17 intervention), 571 students; year 3: 37 teachers (19 inter- 
vention), 670 students]. The majority of teacher participants 
were female (97%) and white (75%; 22% African American, 
and 3% other). The average years of teaching experience was 
11 with a standard deviation of 8. The child sample included 
more males (52%) and African American students (76%; 22% 
White, and 2% other), 61% of the student sample qualified for 
free or reduced lunch, and 9% of the sample received special 
education services (see Table 1 for student demographics). 


Procedures 


The University Institutional Review Board and the participat- 
ing school district approved the study protocol. Teachers and 
students were recruited at the beginning of the school year. 
Data were collected at the beginning of the school year, prior 
to the intervention, and at the end of the school year, post- 
intervention. All pre-intervention assessments occurred in ear- 
ly October. Post-intervention assessments were collected in 
late April and May of the same academic year. 


Intervention Condition Teachers in the TY TCM condition 
attended three sets of two full-day group trainings in late 
October, December, and February. All trainings were co- 
facilitated by two doctoral-level TY TCM group leaders who 
were supervised by the program developer; one of these 
trainers also served as a coach. 

ITY TCM is a comprehensive curriculum for improving 
teacher classroom management skills. Specifically, teachers 
are trained to use proactive classroom management prac- 
tices such as using behavior-specific praise, building posi- 
tive relationships with students, using pre-corrective 
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Fig. 1 TY TCM randomization 
participant flowchart [ 


Enrollment ] 
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Assessed for eligibility 
Teachers (n=109) 
Students (n=2168) 


Excluded (declined to participate) 
Teachers (n=4) 
Students (n=350) 


Classrooms Randomized 
Teachers (n=105; 96%) 
Students (n=1817; 84%) 


| 


Allocated to lY TCM 
Teachers (n=53) 
Students (n=900) 


| 


Allocated to Wait-List Control 
Teachers (n=52) 
Students (n=917) 


| 


Follow-Up | 


Lost to follow-up 
Teachers (n=0) 
Students (n=67; moved) 


Lost to follow-up 
Teachers (n=0) 
Students (n=70; moved) 


| 


Analysis | 


Analyzed 
Teachers (n=53) 
Students (n=833) 


Analyzed 
Teachers (n=51) 
Students (n=847) 


statements, teaching classroom expectations, and using 
proximity to reduce disruptive behavior. Much time during 
all training sessions is devoted to observing video vignettes 
of actual teacher interactions with students. The trainers 
prompt reflections with Socratic questioning about the 
videos (“What is the student learning?,” “How would you 


Table 1 Student participant demographic information 
Control Treatment 
Mean SD Mean SD 

Age 7.06 1.09 75 1.22 

% female 50 48 

% free or reduced lunch 61 60 

% special education 10 8 

% African American 74 76 

% White 23 22 

% other race 3 2 

% grade K 27 28 

% grade | 28 27 

% grade 2 30 19 

% grade 3 15 26 
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respond in this situation?”) and facilitate group discussion. 
These conversations spark role-plays to practice challeng- 
ing interactions. In this way, teachers serve as models for 
others and/or get feedback about improving their skills. 


IY TCM Coaching The TY TCM coach was a doctoral-level 
special educator who was also a certified [YY TCM group 
facilitator. The coaching model is learner-centered, sup- 
portive, and collaborative, and focuses on building on 
teachers’ strengths (see Reinke et al. 2012). In between 
each workshop training session, the TY TCM coach ob- 
served the teachers in the classroom and met with them 
individually for up to 1 h on a weekly basis. The coach 
recorded any contact with teachers, including brief check- 
ins to reviewing strategies and schedule the next meeting. 
The overall mean time spent with a teacher by the coach 
outside of observing in the classroom was 28 min (range = 
4 to 120 min). Time spent with the coach and number of 
coaching visits varied by teacher and was based on need 
for support. The overall mean number of coaching ses- 
sions for teachers in the sample was 7 (range = 3-12). 
Coaching was differentiated based on level of disruptive 
behavior and implementation of effective classroom man- 
agement practices (see Reinke et al. 2012). 
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Fidelity of Implementation Fidelity of implementation of the 
IY TCM training and teacher implementation skills were 
monitored over the course of the year and are documented 
in a separate report (see Reinke, Herman, Stormont, & 
Newcomer 2014). In summary, teachers in the intervention 
were all exposed to the training; nearly all teachers attended 
all six training sessions (attendance rate was 94-100% for 
each training session) and the few teachers who missed a 
training due to illness or other reason met with the TY TCM 
coach to review missed material. The average amount of 
time each teacher spent with the coach over the course of 
the year was 6 h. 

Teacher fidelity to use of effective proactive classroom 
management practices was monitored through direct observa- 
tions which occurred in both TY TCM and control classrooms 
across four time points (October, December, February, and 
April). The results of a repeated measures ANOVA revealed 
a statistically significant difference between LY TCM and con- 
trol teachers, indicating that [YY TCM teachers used more pro- 
active strategies over time in comparison to control teachers 
(Wilks’ \=0.89, F(3, 97) =4.22, p< 0.01, 7° =0.12) (see 
Fig. 2, available online along with a description of the mea- 
sure). Further, because we were interested in whether there 
was an initial increase in proactive management implementa- 
tion following teacher receipt of training and coaching, we 
conducted within subjects contrasts and found that time point 
one was significantly lower than time point 2 [F(1, 50)= 
44.99, p< 0.001, 7° =0.47], time point 3 [F(1, 50) =52.57, 
p<0.001, 7 =0.51], and time point 4 [F(1, 50) = 37.59, p< 
0.001, 7° = 0.43], meaning that teacher implementation im- 
proved significantly after receiving the intervention and main- 
tained over time. 


Measures 


Student Demographics Free and reduced lunch status (FRL), 
race, sex, and special education status were obtained from the 


0.40 
0.35 
0.30 
0.25 
0.20 
0.15 
0.10 


Effect Size 


0.05 


0.00 
1 SD abdve Mean 


1 SD below Mean 


-0.05 


-0.10 


Fig. 2 Differential effect sizes and 95% confidence inervals on social 
competence varying by the pre-test 
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school district for all participating students. Students were 
coded as | if they received FRL and 0 if not. Student sex 
was coded as | for male and 0 for female. Students receiving 
special education were coded as | and if not 0. For the pur- 
poses of this study, student race was coded as African 
American, White, or Other Race. 


Teacher Report of Child Social Behavior and Academics The 
Teacher Observation of Classroom Adaptation-Checklist 
(TOCA-C; Koth et al. 2009) is a 54-item measure of child 
behavior. It was completed by the classroom teachers for 
each child. Teachers were asked to rate each child on the 
items referencing the past 3 weeks. The four subscales of the 
TOCA-C included in the present study were Disruptive 
Behaviors, Concentration Problems, Emotional 
Dysregulation, and Prosocial Behavior. The item responses 
ranged from | (never) to 6 (almost always). Prior studies 
support the factor structure of the TOCA-C (Koth et al. 
2009) as well as strong evidence of subscale predictive va- 
lidity. For instance, longitudinal data from the Prevention 
Intervention Research Center at Johns Hopkins University 
indicated that concentration problem scores in first grade 
predict likelihood of high school dropout and disruptive 
behavior scores in elementary school are strong predictors 
of violence in adolescence and adulthood (e.g., Petras et al. 
2004). Prosocial behaviors, concentration problems, and 
disruptive behaviors also predict office discipline referrals 
(Pas et al. 2011). Previous research of the TOCA-C has 
found internal consistency estimates ranging from 0.86 to 
0.96. For the current study, the internal consistency for each 
subscale ranged from 0.77 to 0.96. 

The Revised Social Competence Scale-Teacher version (T- 
COMP; Gifford-Smith 2000) is a 17-item measure, which 
assesses the teacher’s perception of a child’s prosocial behav- 
ior, emotional self-regulation, and academic competence. 
Teachers were asked to rate each child in comparison to other 
children at their grade level. The total across all items provided 
an overall social competence score. For the purposes of this 
study, the academic competence subscale and the overall so- 
cial competence scale were used. The item responses range 
from 0 (almost never) to 5 (almost always). The T-COMP 
scales have been shown to demonstrate strong internal 
consistency, have a consistent factor structure over time, 
and distinguish between high risk and normative sam- 
ples (Gifford-Smith 2000). For the current study, the 
internal consistency for overall social competence 
ranged from 0.93 to 0.96 and from 0.92 to 0.93 for 
the academic competence subscale. 


Standardized Academic Achievement In addition to teacher 
report of child academic competence, the Woodcock- 
Johnson III Normative Update Tests of Achievement (WJ III 
ACH; Woodcock, McGrew, & Mather 2007) was conducted 
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with each child. The WJ III is an assessment of child academic 
achievement. The present study included two subscales, 
Broad Reading and Broad Math. The WJ III ACH has strong 
psychometric properties (Woodcock, McGrew & Mather 
2007; Bradley-Johnson, Morgan, & Nutkins 2004). 
Specifically, the test-retest reliability for the subtests included 
in the present study range from 0.80 to 0.95 (Bradley-Johnson 
et al. 2004). Research has also documented support for the 
construct validity of the Achievement subtests used in the 
current study (Bradley-Johnson et al. 2004). These data were 
gathered by trained independent researchers blind to the treat- 
ment status. Independent research assistants were trained in 
administration of the WJ III and required to pass a competency 
test before gathering data in the field. 


Intervention Condition Dummy codes were used to indicate 
whether teachers received the intervention or wait list business 
as usual condition with intervention teachers being coded as 1 
and control teachers coded as 0. 


Analytic Approach 
Missing Data 


The original sample included 1817 students. Missing data 
occurred primarily on the outcome measures. The missing 
rates for the pre-tests of eight outcome measures ranged from 
0.4 to 2.3% while the missing rates for the post-tests of eight 
outcome measures ranged from 6.4 to 7.3% in the overall 
sample. The maximum differential missing rates between the 
treatment and control groups are 2.7% for the pre-test and 
0.70% for the post-test. The literature shows that when the 
outcome is included in the imputation model, there are very 
small differences between models that impute the outcome 
compared with those that do not (Kontopantelis et al. 2017). 
We chose to exclude the students whose post-tests were miss- 
ing from the final analytic samples. The final analytic samples 
included nine schools (105 teachers and 1680 students for the 
analyses of social and behavioral outcomes; 105 teachers and 
1685 students for the analyses of academic achievement out- 
comes). The maximum data missing rate in the final analytic 
samples was 1.8%. Multiple imputation using a Markov chain 
Monte Carlo (MCMC) method in SAS PROC MI was used to 
impute missing data on pre-test and other covariates and the 
outcome measures were included in the imputation models. 
We imputed five times given the small missing rate (Rubin 
1987; Schafer and Olsen 1998). 


Analysis of Main Effects 


For each of the five imputed datasets, three-level hierar- 
chical linear models (HLM), in which students (level 1) 
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are nested within teachers (level 2) and teachers are 
nested within schools (level 3), were conducted using 
SAS PROC MIXED to examine the overall treatment ef- 
fects student behavior and academic outcomes. Each stu- 
dent’s pre-test and demographic information were includ- 
ed at level 1, and the treatment variable was at level 2 and 
its coefficient was assumed constant across level 3. SAS 
PROC MIANALYZE was used to combine the results 
from the analyses of five datasets. The statistical model 
is below: 


Level (student): Yi = og + Y OgneX oie 
1 


= 
+ Cijks eik~N (0, a) 
Level 2(class) 


Qj = Poox + Porx (Condition) x, + Lj, 
Ogi = Bor, d = 1,..-,0. 


Level 3(school) 


 Uje~N (0, 5) 


Book = Yooo + & 
Bork = Yoo 
Book = Yqo0 7 _ 1, saihg Q. 


, &~N (0,73) 


where X,,;;, represents student-level covariates, which include 
pre-test, age at pre-test, gender, race, FRL, special education 
status, grade level, and cohort year in the study. (Condition), 
is a binary variable indicating treatment condition 
(Condition = 0 for control group and Condition = 1 for treat- 
ment group). The parameter, 70), estimates the overall treat- 
ment effect, which is assumed constant across schools. 0”, Tas 
and 73 are variance components for level 1, level 2, and level 3 
conditional on these covariates. 


Moderation Analysis 


Moderation analyses were conducted to examine whether 
the treatment effects on child outcomes differed by demo- 
graphic variables and pre-test measures of social emotion- 
al and disruptive behavior and academics. The statistical 
models were similar to the models with main effects but 
had the additional interaction term of treatment and mod- 
erator. Specifically, in the level 2 model, we included the 
treatment condition to predict to the coefficient of the pre- 
test that was grand mean centered. 


agit = Boog + Boie(Condition) , + [jx 


Level 2(class) : git = Byox + Byix(Condition) ,,q = 1,..., 


0.” ue~N (0,73) 


The parameter, 3,),, estimates the moderator effects of 
the gth covariate and is assumed constant across schools 


(Bir = Yqi0): 
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Results 
Descriptive Statistics 


ESM 1 provides descriptive statistics for the study vari- 
ables (available online). The effect sizes indicated that the 
baseline measures were equivalent between the two con- 
ditions. HLM results for three-level models examining the 
effects of YY TCM on social behavior and academic out- 
comes and moderation analyses are provided below. The 
unconditional intraclass correlations (ICCs) ranged from 
0.02 to 0.05 at school level and from 0.06 to 0.18 at class 
level for social behavior measures. This suggests that big- 
ger proportion of variance on the social behavior mea- 
sures exist between-classrooms than between-schools 
and children with behavior problems may be clustered 
into the same classroom. The unconditional ICCs ranged 
from 0.03 to 0.07 at school level and from 0.04 to 0.08 at 
class level for academic outcome measure. 


Main Effects on Social Behavior 


Table 2 provides the main effects of the intervention on social 
behavior outcomes. In Table 2, the list of baseline variables 
included in the analyses is noted on the left-hand side. The 
outcome variables are indicated across the top of the table. 
Teacher ratings of African American students and boys indi- 
cated that they had more concentration problems, disruptive 
behavior, emotion dysregulation, and lower prosocial behav- 
ior and social competence. Further, students in special educa- 
tion were rated as having more concentration problems, and 
students receiving FRL had more concentration problem and 
lower social competence. These demographic variables were 
included as covariates in each model given the strong associ- 
ations found in the literature between these variables and so- 
cial behavior. Baseline measures of the same outcome vari- 
ables were also covariates in the model. Therefore, the post- 
intervention scores represent change between baseline and 
post-assessment. Main effect analyses demonstrated that stu- 
dents in TY TCM showed significant improvement on teacher- 
reported prosocial behavior (b=0.14, p=0.038, d=0.13), 
overall social competence (6=0.14, p=0.032, d=0.13), 
and reduced emotional dysregulation (b6=— 0.15, p<0.001, 

=-— 0.14) compared to students in the control condition. 
There were no significant effects for disruptive behavior or 
concentration problems. 


Main Effects on Academic Outcomes 


Table 3 provides the main effects of the intervention on aca- 
demic outcomes. Several demographic variables that are 
known to be associated with academic outcomes were includ- 
ed in the models as covariates. Students receiving special 
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education services and African American students had lower 
teacher ratings of academic competence and lower reading 
and math scores. Younger students also had lower scores in 
reading and math. Teachers rated boys as having higher aca- 
demic competence than girls. There were no main effects on 
standardized reading or math scores. However, teacher- 
reported academic competence demonstrated a trend favoring 
students in the TY TCM classroom in comparison to control 
classrooms (b = 0.11, p=0.074, d=0.08). 


Moderating Effects 


Tables 2 and 3 also provide the moderation effects of pre-test 
measures on outcomes. Demographic information as modera- 
tors were not statistically significant at an alpha of 0.05. Thus, 
only the results for pre-tests as moderators were reported here. 
Pretests were centered at the grand mean. Two of the pre-test 
measures had statistically significant moderation effects. 
Overall social competence was moderated by pre-test levels 
of social competence (b=— 0.09, p =0.04), indicating that 
students with lower social competence at pre-test who were 
in intervention classrooms demonstrated greater increases in 
social competence over time in comparison to similar peers in 
control classrooms. Similarly, students with lower levels of 
academic competence at pre-test demonstrated greater in- 
creases in academic competence over time in comparison to 
similar peers in the control classrooms (b = — 0.08, p < 0.001). 
Figures 2 and 3 present the effect sizes and their 95% confi- 
dence intervals at the mean of the baseline pretest, and one 
standard deviation below and above the mean pre-test for the 
social competence and academic competence measures, 
respectively. 


Discussion 


This group RCT investigated the efficacy of the LY TCM as a 
stand-alone program among teachers in classrooms kindergar- 
ten to third grade on child social behavior and academic out- 
comes. It was hypothesized that students in the classrooms of 
teachers who received the [YY TCM would exhibit reductions 
in disruptive behavior, concentration problems, and emotional 
dysregulation. In addition, students in the [YY TCM classrooms 
were expected to demonstrate increases in prosocial behavior, 
social competence, and improvements in academics. 

The first hypothesis was partially supported in that students 
inITY TCM classrooms demonstrated a significant reduction in 
emotional dysregulation and improvements in prosocial be- 
havior and social competence relative to students in business 
as usual classrooms. However, there were no significant find- 
ings for disruptive behavior or concentration problems. It was 
expected that TY TCM would demonstrate significant proxi- 
mal impacts on concentration difficulties and disruptive 
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Fig. 3 Differential effect sizes and 95% confidence inervals on academic 
competence varying by the pre-test 


behavior such as has been found with other universal behavior 
interventions (Bradshaw et al. 2012; Kellam et al. 2008). 
Notably, all schools in the present study were implementing 
a school-wide behavior support program (PBIS) with high 
fidelity. Prior studies have found significant effects of these 
school-wide practices in reducing disruptive behaviors. Thus, 
in this study, YY TCM may have had smaller effects on dis- 
tuptive behaviors above and beyond any changes that may 
have been related to implementing PBIS. 

IY TCM helped to decrease emotion dysregulation. 
Students with emotion regulation skills are more likely to 
be academically successful (Raver et al. 2017). Thus, de- 
creasing dysregulation can be a proximal outcome toward 
improving student achievement. In addition, students in the 
intervention demonstrated improvements in prosocial be- 
haviors and social competence. The finding that the inter- 
vention improved social competence at the end of the year 
for youth with lower levels of baseline social competence 
is particularly encouraging. This demonstrates that a univer- 
sal classroom management approach can help to mitigate 
risk for youth with initially lower levels of social compe- 
tence potentially leading to reductions in the number of 
students who would otherwise need more intensive sup- 
ports in this area. 

The absence of intervention effects on academic achieve- 
ment scores were not entirely surprising given that perfor- 
mance on standardized measures of achievement is a fairly 
distal outcome relative to changes in classroom behaviors. 
Improving academic enablers, such as coaching academic per- 
sistence, promoting effective problem solving and social skills 
(Elliott et al. 2004), and increasing emotional regulation skills 
(Zimmerman 1998), may increase student access to instruc- 
tion and learning. Here we found evidence that [Y TCM pro- 
moted teacher-rated academic competence for youth with 
lower levels of competence at the start of the year. 

The effect sizes on self-regulation, prosocial skills, 
and social competence were relatively modest; however, 
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small effect sizes are common in longitudinal universal 
prevention studies (Durlak et al. 2011). Small effects are 
expected from universal preventive interventions given 
that they are delivered to entire populations with vary- 
ing degrees of risk (i.e., many individuals would not 
develop behavior or academic problems even without 
the intervention); yet very small effects on a population 
level can result in dramatic improvements in public 
health outcomes (NRC and IOM 2009). Prior studies 
of the IY TCM as a stand-alone intervention systemat- 
ically either included only students at risk for conduct 
problems (Hitchings et al. 2013) or had a larger per- 
centage of students with elevated conduct problem 
scores (Hutchings et al. 2007). Thus, there was more 
room for improvement among these samples than in 
the current study, explaining the larger effect sizes seen 
in those studies. 


Study Limitations 


While the findings are interesting and important, this study 
is not without some limitations. First, all schools in this trial 
were implementing PBIS with high fidelity. It is possible 
that this school-wide universal intervention to support stu- 
dent positive behavior reduced the effect that could be de- 
tected with the addition of a classroom level intervention, 
particularly on student disruptive behavior. Second, the find- 
ings from the study were predominantly on measures of 
teacher report. Teachers were also the recipients of the train- 
ing to implement TY TCM practices, leading to the potential 
that teachers who received training may have rated their 
students as improved due to being exposed to the interven- 
tion. Despite this, teachers are the most common source of 
information used to assess social behavior and determine 
special education evaluations (Zima, Haltburt, Kinapp, et 
al. 2005); thus, their ratings are important in the context of 
school-based interventions and have been shown to predict 
social behavioral problems (Koth et al. 2009; Reinke et al. 
2008; Schaeffer et al. 2003). Importantly, independent ob- 
servations revealed that teachers who received the TY TCM 
demonstrate significant improvement in their use of proac- 
tive classroom management strategies in comparison to con- 
trol teachers. The lack of long-term follow-up in this study is 
also a limitation. Some of the more proximal findings in this 
study may lead to improvements in more distal outcomes, 
but this cannot be confirmed without follow-up. Lastly, in 
this study, we do not report the indirect impacts of teacher 
behavior on student outcomes. Given the complex nature of 
the TY TCM intervention and the need to systematically 
investigate the potential mechanisms for mediation, we plan 
to conduct these analyses in a separate study in hopes to 
elucidate the proximal mechanisms of change leading to 
student outcomes. 
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Future Directions 


The present findings suggest that YY TCM holds promise as 
a universal prevention program for supporting teacher use 
of effective classroom management practices and for pro- 
moting youth prosocial behavior, emotion regulation, and 
social competence. Future research will examine the mech- 
anisms by which IY TCM impacts youth outcomes. 
Additionally, given the intense and comprehensive nature 
of the [Y TCM, researchers may want to look toward iden- 
tifying the critical ingredients of the intervention by dis- 
mantling the [YY TCM components. Determining whether 
particular components of the training have a greater impact 
on particular social or academic behaviors could increase 
feasibility and focus for schools. Further, investigating 
whether some teachers benefit more from the LY TCM train- 
ing than others would be of interest. Perhaps fewer training 
days are necessary for teachers who have a higher rate of 
proactive classroom management practices. Additionally, 
future research could systematically assess additional aca- 
demic enablers that could lead to later academic achieve- 
ment improvements for students. For instance, the finding 
that LY TCM impacted academic competence for those stu- 
dents with lower levels of academic competence at baseline 
raises the question whether these students will demonstrate 
further improvements in academic achievement more dis- 
tally. Long-term follow-up of students may help to specify 
the connection between these more proximal indicators on 
later improvement in academic achievement. Finally, some 
students have co-occurring problems, including academic 
and behavioral issues. Future research can use person- 
centered methods, such as latent profile analysis, to deter- 
mine if students with co-occurring problems differentially 
respond to this intervention. 
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